Phase transition in sparse associative neural networks
نویسندگان
چکیده
We study the phenomenon of phase transition occurring in sparse associative neural networks, which is characterized by the abrupt emergence of associative properties with the growth of network connectivity. It is shown that this discontinuous behaviour is caused by the specific way of architecture selection. Based on empirical results the relationship among critical parameters is suggested.
منابع مشابه
A Self-Reconstructing Algorithm for Single and Multiple-Sensor Fault Isolation Based on Auto-Associative Neural Networks
Recently different approaches have been developed in the field of sensor fault diagnostics based on Auto-Associative Neural Network (AANN). In this paper we present a novel algorithm called Self reconstructing Auto-Associative Neural Network (S-AANN) which is able to detect and isolate single faulty sensor via reconstruction. We have also extended the algorithm to be applicable in multiple faul...
متن کاملNeural associative memories and sparse coding
The theoretical, practical and technical development of neural associative memories during the last 40 years is described. The importance of sparse coding of associative memory patterns is pointed out. The use of associative memory networks for large scale brain modeling is also mentioned.
متن کاملA linear approach for sparse coding by a two-layer neural network
Many approaches to transform classification problems from nonlinear to linear by feature transformation have been recently presented in the literature. These notably include sparse coding methods and deep neural networks. However, many of these approaches require the repeated application of a learning process upon the presentation of unseen data input vectors, or else involve the use of large n...
متن کاملHigh Performance Associative Neural Networks: Overview and Library
Associative neural networks are regaining the popularity due to their recent successful application to the problem of real-time memorization and recognition in video. This paper presents a comparative overview of several most popular models of these networks, such as those learnt by the Projective Learning rules and having Sparse architecture, and introduces an Open Source Associative Neural Ne...
متن کاملA study of retrieval algorithms of sparse messages in networks of neural cliques
-Associative memories are data structures addressed using part of the content rather than an index. They offer good fault reliability and biological plausibility. Among different families of associative memories, sparse ones are known to offer the best efficiency (ratio of the amount of bits stored to that of bits used by the network itself). Their retrieval process performance has been shown t...
متن کامل